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Abstract.  It  is  shown  that  if  a  stochastically  monotone  Markov  process  on  [0,4p)  •' 

with  stationary  distribution  H  has  its  state  space  truncated  by  making:  all  states  in  [B,  fo]  _ ' 
absorbing,  then  the  quasi-stationary  distribution  of  the  new  process  converges  to  H  as 

y  r.ijiZotVs-  1  £* 

1.  Introduction. 

Let  X{t),  0  <  t  <  oo,  be  a  Markov  process  with  state  space  [0,oo).  If  the  process  is 
absorbing,  its  quasi-stationary  distribution  is  defined  to  be  the  limit  (if  it  exists)  as  t  -♦  oo 
of  the  distributon  of  Jf(t)  given  that  absorption  has  not  occurred  by  the  time  t  (e.g.  Seneta 
and  Vere-Jones,  1966).  We  shall  consider  a  process  which  in  fact  has  a  limiting  probability 
distribution  H  in  the  sense  that  for  every  initial  state  X(0)  =  z, 


UrnF-WO  <*>  =  *(»)  (1) 

at  continuity  points  y  of  H,  but  which  is  made  into  an  absorbing  process  by  introduction 
of  the  stopping  time 

r  =  rB  =  inf{t :  X(t)  >  B)  (B  >  0).  (2) 

The  absorbing  process  X(t  A  t),  0  <  t  <  oo,  may  have  a  quasi-stationary  distribution 

lim  P*{X(t)  <  y  |  r  >  «}, 


and  a  natural  question  is  whether  this  distribution  converges  to  H  as  B 


oo.  More 


generally,  we  shall  be  interested  in  establishing  under  some  conditions  that  as  t,  B  —*  oo 

P*{X(t)  <  y  |  r  >  «}  —  H(V)  (3) 

for  all  x  and  continuity  points  y  of  H. 

Our  principal  result,  Theorem  1,  asserts  that  (3)  holds  if  the  process  X(t)  is  stochas¬ 
tically  monotone.  (See  Section  2  for  the  definition.)  We  also  ask  whether  the  hypothesis 
of  stochastic  monotonicity  implies  the  condition  (1)  and  show  that  under  a  mild  condition 
of  communicability  it  does  (Theorem  3),  although  the  limit  H  obviously  need  not  be  a 
probability  distribution. 

Seneta  (1980),  Section  7.3,  in  the  special  case  of  Markov  chains,  has  studied  the  con¬ 
vergence  of  quasi-stationary  distributions  (assumed  to  exist)  for  a  truncated  state  space  to 
the  stationary  distribution  of  the  original  chain.  His  methods  and  results  are  completely 
different  than  ours. 

Our  motivation  to  consider  the  problem  discussed  here  comes  from  our  efforts  to  com¬ 
pare  competing  stopping  rules  in  a  quickest  detection  problem  (Poliak  and  Siegmund,  1984). 
There  we  were  concerned  with  two  diffusion  processes  on  [0,  oo),  which  ‘detect”  a  change  in 
the  drift  of  an  underlying  Brownian  motion  process  if  they  ever  reach  a  given  high  level  B. 
We  were  interested  in  evaluating  the  expected  delay  from  the  time  that  the  change  actually 
occurs  until  it  is  detected,  given  that  the  change  has  not  been  falsely  detected  before  its 
occurrence.  If  the  change  occurs  after  the  process  has  been  running  for  some  time,  we  must 
evaluate  the  expected  first  passage  of  our  (changed)  diffusion  processes  to  the  level  B,  given 
that  they  start  in  the  quasi-stationary  distribution.  Since  the  quasi-stationary  distribution 
is  rather  difficult  to  evaluate  in  one  case,  and  since  B  is  almost  always  quite  large,  it  is 
natural  to  consider  the  quasi-stationary  distribution  as  B  — *  oo,  or  more  generally  the 
convergence  indicated  in  (3). 

2.  Remits. 

Let  Xn,  r*  =  0, 1,2,  •  ■  •  be  a  Markov  process  in  discrete  time  with  state  space  [0,oo) 
and  stationary  transition  probabilities.  We  write  P*  to  denote  probability  for  the  process 
with  initial  state  X*  m  x. 


We  shall  call  the  process  stochastically  monotone  if  P*{X\  >  y}  is  nondecreasing  and 
right  continuous  in  z  for  all  y.  (Right  continuity  is  not  usually  included  in  this  definition 
and  for  some  purposes  is  easily  eliminated.  Since  it  seems  harmless  in  applications,  we  have 
not  tried  to  achieve  the  utmost  generality.) 

Theorem  1.  Let  X„,  n  =  0, 1, 2,  *  •  •  be  stochastically  monotone,  and  let  r  be  defined  by 
(2).  For  arbitrary  x,y,B  >  0  and  m  =  1, 2,  •  •  • 

P* {Xm  <y\r>tn}>  P’{Xm  <  y).  (4) 

If  (1)  is  also  satisfied,  then  as  B,  m  —»  oo,  for  arbitrary  z 

P*{Xm  <  y  |  rB  >  m}  -*  H(y)  (5) 


at  a 11  continuity  points  y  of  H. 

Proof.  We  begin  by  proving  (4),  which  is  trivial  for  m  =  1.  Suppose  it  is  true  for  m  —  n, 
and  consider  the  case  m  =  n  +  1, 


pMf  y  /y|»  NnAll  -  ^  V  I  **  ^ 

P  {Xn+i  <y\  r>n  +  l}  p»^B+1  <  JJ  |  r  >  n} 


>  [  P*{Xn€dz\r>n}P’{Xl<y} 


To  perform  the  following  manipulations  it  is  convenient  (although  not  necessary)  to 
introduce  the  dual  probability  P  in  the  sense  of  Siegmund  (1976),  under  which  {AT*,  n  = 
0, 1,  •  •  •}  is  again  a  Markov  chain  and  satisfies 


/*<X*  >*}  =  /*{**<«} 


for  all  2,  y  €  (0,  oo)  x  [0,  oo).  Then  (6)  can  be  continued  as  follows 


=  /  P*{Xn  G  dz  |  r  >  »}£»{*!  <  z} 

■'103) 

*  f  P*{Xn  6  dz  |  r  >  n}  /  P*{X,  €  d« 

•'[03)  •'(o,#) 

=  /  P>{Xt€d(}(  P’{Xn€dz\r>n} 

0,oc)  J|03Af) 

f\0,oo) 


(7) 


=  /  F'{X1€d{}P*{Jfll<BAe|r>n} 

*'|0,oo) 

>  /  p»{*,  e  dtfp*{*,,  <  £} 

•f[0,oo) 


The  inequality  follows  from  the  inductive  hypothesis  if  f  <  B  and  because  the  conditional 
probability  equals  1  if  £  >  B.  Hence  the  last  expression  in  (7)  equals 


f  P’{Xx  €  f }  [  P*{Xm  £  dz)  =  /  P-{Xm  €  >  *} 

*|0,oo)  J[0,()  J  (0,oo) 

-  /  P'{X„  €  d»}P*{*i  <  y}  =  P*{XW+1  <  y}, 

JlOjoo) 


[Ofio) 

which  completes  the  proof  of  (4). 

From  (4)  and  the  hypothesis  (1)  it  follows  that 


limmf  P*{XM  <  y  |  rB  >  m>  >  JT(y). 

"•3 

Hence  it  remains  to  prove  the  reverse  inequality. 

Let  c  >  0  and  fix  &  so  large  that 

P°{*»  <  y>  <  H{y)  +  c. 

For  arbitrary  0  <  q  <  1,  by  (4)  and  hypothesis  (1)  there  exists  7  >  0  such  that  for  all  n,  B 
Pm{Xm  <  7  I  rB  >  n>  £  Pa{Xm  <  7}  >  1  -  fi. 

Also  for  any  0  <  6  <  1  there  exists  Bg  such  that  for  all  B  >  Bo 


Hence  for  all  m  >  k  and  B  >  Bo 

P*{Xm  <  y  |  r  >  m}  =  Pa{Xm  <y\r>m-k,  r>m} 

=  P“{r  >  m,  Xm  <  y  l  r  >  m  -  k}/P“{r  >  m  |  r  >  m  -  k) 

.  /lo*)  P*{Xm-k  €  d*  |  r  >  m  -  *}/”{**  < 

-  /,M  P'{Xm.k  €  dz  |  r  >  m  -  >  *} 

<  P°{XU  <  y}/Pa{Xm.k  <  7  |  r  >  m  -  k}Pi{r  >  *} 

<  Wv) +  <]/(!- •»)(!-«)• 

Since  e,  t j,  and  S  are  arbitrary  this  completes  the  proof. 

It  is  straightforward  to  extend  Theorem  1  to  the  case  of  a  continuous  time  Markov 
process.  In  fact,  it  is  only  the  proof  of  (4)  that  rres  the  discreteness  of  the  time  scale;  and 
this  inequality  is  easily  extended  to  continuous  time  by  a  limiting  process. 

More  precisely,  the  Markov  process  0  <  t  <  oo,  with  stationary  transitions  is 
called  stochastically  monotone  if  for  some  h  >  0  and  for  all  0  <  t  <  h,  Pa{X(t)  >  y}  is 
nondecreasing  and  right  continuous  in  *  for  all  y.  Hence  for  any  0  <  c  <  h  the  discrete 
skeleton  JT(nc),  n  =  0, 1,  •  •  *,  is  stochastically  monotone,  so  equation  (4)  holds  for  it.  If  we 
now  add  a  smoothness  assumption  on  the  sample  paths,  say  that  they  are  right  continuous, 
we  obtain  a  version  of  (4)  by  passing  to  the  limit  as  e  -*  0.  For  completeness  we  summarise 
these  results  in  the  following  theorem. 

Theorem  2.  Let  X(t),  0  <  t  <  oo,  be  stochastically  monotone  with  right  continuous 
sample  paths,  and  let  r  be  defined  by  (2).  For  arbitrary  x,y,B,  and  t  >  0 

P*{X(t)<yjr>t}>F*{X(t)<y}. 

If  (1)  is  also  satisfied,  then  as  B,t  -*  oo,  for  arbitrary  x 

e*  W«)  <»!>•><}-  Bit) 

at  all  continuity  points  y  of  H. 

Remark.  Simple  coupling  arguments  show  that  birth  and  death  and  diffusion  processes 
are  stochastically  monotone,  so  Theorem  2  applies  to  them,  hi  particular  it  applies  to  the 
two  diffusion  processes  which  motivated  our  investigation.  (See  Lemma  1  of  Poliak  and 
Siegmund,  1984.) 
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We  now  ask  whether  our  two  basic  assumptions,  stochastic  monotoxucity  and  existence 
of  a  limiting  distribution,  are  to  some  extent  redundant.  If  X„,  n  =  0,1,  -  •,  (or  X(t), 
0  <  t  <  oo )  is  stochastically  monotone,  with  state  space  [0,oo),  it  follows  from  Theorem  1 
of  Siegmund  (1976)  that  there  is  a  dual  probability  P  under  which  Xn,  n  =  0, 1,  •  ■  •,  is  a 
Markov  chain  with  stationary  transition  probabilities  which  satisfy 

Pa{Xn  >  y}  -  f"{Xn  <  *}.  (8) 

By  putting  y  =  0  we  see  that  0  is  an  absorbing  state  for  the  P  process,  bo  for  x  —  0 

P°{X„  >y}  =  Fix*  -  0}  -  po  =  0>^  ,  (9) 

which  is  increasing  in  n  and  hence  has  some  limit,  say  B(y).  Of  course,  B  need  not  be 
a  probability.  The  following  theorem  shows  that  under  an  hypothesis  of  communicability, 
PM{X„  >  y}  -*  B(y)  for  arbitrary  initial  states  x. 

Theorem  S.  Let  x  >  0.  If  limn— <»  P°{XH  >  z}  =  B(z)  >  0,  then  for  all  y  limn_oo  Pa{X, , 
>  y)  exists  and  equals  B(y). 

We  begin  with  a  simple  lemma. 

Lemma  1.  Let  f0  =  inf {n  :  X„  =  0}.  If  lim  sup„  P*{tq  >  n,  XH  <  x}  >  0,  then 


P*{f  =  oo,  Xn  <  x  i.o.  }  >  0. 


Proof  of  Lemma  1.  Since 


we  have 


{f0  =  oo,  Xn  <  *i.o.}  =  p  Qfo  >  n,Xn  <  x}, 

1=1  n=l 

P*{.Tq  =  OOtXn  <  *1.0.}  =  n,Xm  ~ 

>  limsupPr{n>  >  k,X i  <  s}  >  0. 


Proof  of  Theorem  8.  In  terms  of  the  stopping  time  f»  of  Lemma  1,  the  relation  (8) 


becomes 


P‘{Xm  >  y}  =  P'to  £  n)  +  >  n,Xm  £  x) 

«  P*{Xn  >  y}  +  P*{b  >n,Xm<  *}, 


k«: 


so  it  suffices  to  show  that 


P*{hi  >  n, Xn  <  *}  -»  0 


as  n  — *  oo.  If  this  is  not  true,  then  by  Lemma  I 

P*{ro  =  oo,  Xn  <  x  i.o.}  >  0.  (10) 

Also,  by  (9)  and  the  assumption  of  the  Theorem,  there  exist  6  >  0  and  no  such  that  for  all 


0  <  *  <  *, 


i*{?o  <  no}  =  P°{Xno  >£}>  \R(*)  >  6. 


Let  rj1*  =  inf  {n  :  Xn  <  *}  and  for  N  =  2, 3,  •  •  •  let  ri^  =  inf{n  :  n  >  +no,X„  <  z}. 

Also  let  =  inf{n  :  n  >  X„  =  0}  and  put  Bn  —  <  oo,  -  rj^  >  no}. 

Obviously  {n>  =  oo,  Xn  <  x  i.o.}  C  Ojv=i  ^7  (11) 

^(n^)=E  *"  Qi  B"  n  {rJ"°  =  €  df}^  >  no} 

<(1-  6)P'  (J)  Bn^  <  • •  ■  <  (1  -  S)m ■ 

Hence  P,{f0  =  oo,  X„  <  x  i.o.}  =  0,  which  contradicts  (10)  and  completes  the  proof. 
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